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PREFACE 


This Note contains the appendices of the RAND report (R-3943-FMP) 
that describes the PACER SHARE Demonstration Project and the plan that 
has been developed to evaluate it. The report also presents statistical 
results concerning quality of work life, organizational flexibility, 
work quality, and productivity during the baseline period prior to the 
demonstration and throughout its first year. The appendices present the 
survey questionnaire used in the first-year evaluation and provide 
supplementary statistical results. 

The study is funded by the U.S. Air Force through a special 
arrangement with the Office of the Assistant Secretary of Defense for 
Force Management and Personnel, the research sponsor. It is being 
carried out by the Defense Manpower Research Center, a component of the 
National Defense Research Institute, RAND's federally funded research 
and development center sponsored by the Office of the Secretary of 


Defense and the Joint Chiefs of Staff. 
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Appendix A 
YEAR ONE FOLLOW-UP SURVEY QUESTIONNAIRE 


This appendix presents an annotated version of the questionnaire 
used in the year one follow-up survey of the work forces at the Air 
Logistics Centers. The item numbers (Vl, V2, etc.) correspond to the 
variable names used in the analyses. Items in the "200" series are 
questions added to the questionnaire for the follow-up. Items marked 
with an asterisk were asked of Sacramento only, and items with a double 
asterisk were asked at the comparison sites only. 


SURVEY OF ATTITUDES IN THE DIRECTORATE OF DISTRIBUTION 


PLEASE DO NOT TURN THIS PAGE UNTIL YOU ARE ASKED TO DO SO. 


This survey was designed to enable you to provide information on 
how you feel about your work at the Directorate of Distribution (DS). 
The results of the survey are completely confidential and anonymous. 
The completed questionnaires will be taken to The RAND Corporation in 
Santa Monica, California for analysis. No individual respondents will be 
identified. No completed questionnaires will be given to DS--only 
statistical summaries will be provided. We have taken these steps to 
enable you to answer the questionnaire as openly and honestly as you 
can. Please feel free to do so. Completion of the questionnaire is 
voluntary. We appreciate your cooperation. 


SECTION 1: 


CURRENT ATTITUDES 


Each statement in this section concerns your feelings about your work at 


the Directorate of Distribution (DS). 


you agree or disagree with each statement. 
box below the response that best indicates how you feel. 
interested in YOUR feelings about YOUR work situation. 


or wrong answers to these questions. 


Please indicate the extent to which 

Mark an "X" in the numbered 
Remember, we are 

There are no right 


Vi. I usually know whether or not my work is satisfactory. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agree 

[1] [2] [3] [4] (3] 
V2 Regular pay increases here depend on how well a person performs 
his/her job. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
(21] {2} [3] [4] [5] 

V3. The union and management are hostile toward each other. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agree 

[1] [2] [3] [4] [5] 

V4. My unit works well together. 

Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 

V5 If we have a decision to make, everyone is involved in making it. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agree 

{1) [2] [3] [4] [5] 


V6. 


V7. 


V8. 


v9. 


V10. 


Under the present system it is very difficult to motivate employees 


with financial rewards. 


Strongly 
Disagree Disagree Undecided Agree 


[1] {2] [3] [4] 


Strongly 
Agree 
[5] 


When changes are made in DS, the employees usually lose out in the end. 


Strongly 
Disagree Disagree Undecided Agree 
{1] [2] [3] [4] 


Strongly 
Agree 
[5] 


Considering my skills and the effort I put into my work I am 


satisfied with my pay. 


Strongly 
Disagree Disagree Undecided Agree 
[1] [2] [3] [4] 


High performers tend to stay with DS. 
Strongly 


Disagree Disagree Undecided Agree 


(1] (2] [3] (4 ] 


What happens to DS is really important to me. 


Strongly 
Disagree Disagree Undecided Agree 
{1] [2] (3] [4] 


I have confidence and trust in my co-workers. 


Strongly 
Disagree Disagree Undecided Agree 
{1} [2] [3] [+] 


It is clear how pay decisions are made around here. 


Strongly 
Disagree Disagree Undecided Agree 
[1] [2] (3] [+] 


Strongly 
Agree 
[5] 


Strongly 
Agree 
[3] 


Strongly 
Agree 
[5] 


Strongly 
Agree 


[3] 


Strongly 
Agree 


[5] 


~S5- 
V13. Employees here feel you can't trust management in this directorate. 
Strongly Strongly 
Disagree Disagree Undecided Agree Ayree 
(1] [2] (3] [4] [5] 


V14. My job duties are clearly defined by my supervisor. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
as [2] [3] [4] (3] 
V15. My supervisor encourages subordinate to participate in important 


decisions. 


Strongly Stronely 
Disagree Disagree Undecided Agree Agree 
{1] [2] [3] [4] [5] 


V16. To help DS, it is necessary that I think of ways to help other 
sections, branches, or divisions do their jobs. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] 14] (3] 
V17. I have control over how I spend my time working. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agre 
[1] [2] [3] (4] [3] 
V18. My co-workers encourage each other to give their best effort. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [+] [3] 
V19. My supervisor handles the administrative parts of his/her job well. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


(1] [2] [3] [4] [3] 


V20. 


I am satisfied with my opportunities for advancement. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] (2] [3] [4] [3] 


My supervisor gives me adequate information on how well I am 
) g q 
performing. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] {2] [3] [4] [5] 
Other employers in this area pay more than the government does for 
the kind of work I am doing. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


(1] [2] (3] [4] [5] 


My supervisor has strong technical skills. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


Promotions here depend on how well a person performs his/her job. 
Strongly Strongly 


Disagree Disagree Undecided Agree Agree 


[1] [2] [3] [4] [5] 


Coming up with new ways to do my job leads to good job performance. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [3] 


If I had the chance I would take a different job within DS. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] {2] {3] [4] [5] 


V27. I will be promoted or given a better job if I perform especially weil. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] +] [5] 


V28. My supervisor demands that people give their best effort. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] {2] [3] [4] [5] 


V29. My pay is determined by my individual job performance. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] [2] [3] [4] [5] 


V30. I could find a job with another employer with about the same pay 
and benefits as I now have. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


V31. My supervisor works well with people. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
(1) [2] {3] [4] [5] 


V32. All in all, I am satisfied with the position classification 
procedures in DS. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [3] 


V33. My job allows me to achieve personal satisfaction. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


(1] [2] [3] [4] [5] 


V34. My supervisor is interested in my opinion on how to improve things 


in DS. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] {2] [3] [4] [3] 


V35. DS gives me adequate training to do my job well. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
(1] [2] (3] [4] (5] 


V36. If DS saves money because we (i.e., the employees) work harder or 
better, some of the savings will be shared with us. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 
V37. I will be demoted or removed from my position if I perform my 
job poorly. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
(1) [2] [3] [4] [5] 


V38. In DS, conflict that exists between work units gets in the way 
of getting the job done. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
(1] (2] [3] [4] [5] 


V39. My supervisor keeps informed about the way subordinates think and 
feel about things. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [+ [5] 


V40. Management in DS is concerned about me as a person. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] {2] [3] [4] [3] 


V4l. 


V42. 


V43. 


V44, 


V46. 


V47. 


If one of my co-workers isn't working hard enough, I would 
tell him/her so. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] [2] {3] [4] [3] 


It is necessary for DS to mininize cosis and maximize performance. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
(1] [2] [3] [4] [3] 
Working hard on my job leads to good job performance. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


(1] [2] (3] [4] (5] 


It is necessary for everyone in DS to help support other 
directorates such as Maintenance. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
{1} [2] [3] [4] [5] 
In general, I like the way the union handles things. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] {2] [3] [4] [53 
Coordination among work units is good in DS. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
(1) [2] {3] (4] [5] 


It would be very hard for me to leave my job even if I wanted to. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] 4] [5] 


V49. 


V51. 


V52. 


V53. 


V54. 


Pay differences in DS fairly represent real differences in levels 
of responsibility and job difficulty. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


I deserve most of the credit or blame for how well my work gets done. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


My supervisor sets clear goals for me in my present job. 
Strongly Strongly 


Disagree Disagree Undecided Agree Agree 


[1] [2] [3] [4] [5] 


I will be given simpler work or less work if I perform my job poorly. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


People in DS will do things behind your back. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
(1) [2] [3] [4] [5] 


To help DS it is necessary that I think of ways to help my 
section do its job. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] {3] [4] [5] 


In general, J like working here. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


(1} [2] [3] [4] [3] 


I have a great deal of say over what has to be done on my job. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


(1] [2] [3] [4] [3] 


If I have ideas on how other people in DS could improve their 
work I should tell their supervisors. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] [2] [3] [4] [5] 


co-workers are afraid to express their real views. 


Strongly Scrongly 
Disagree Disagree Undecided Agree Agree 


[1] [2] {3] [4] [5] 


general, I am satisfied with my job. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] [2] [3] [4] [5] 


DS, employees receive equal pay for equal work. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


(1] (2] [3] [4] [3] 


The amount of money I will receive for working harder is enough to 
make me work harder. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


(1] [2] [3] [4] [5] 
Working hard on my job leads to gaining respect from my co-workers. 
Strongly Strongly 


Disagree Disagree Undecided Agree Agree 


[1] [2] [3] [4] [5] 


V63. 


Vé64. 


V65. 


V6é6. 


V67. 


V68. 


I am personally responsible for helping DS improve its performance. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
(1] [2] (3] [4] [5] 


Low performers tend to leave DS. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
(1} [2] [3] [4] [5] 


In DS, you make more money in blue-collar jobs than in 
white-collar jobs. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


New employees in DS are well qualified for their jobs. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


In general, disciplinary actions taken in DS are fair and justified. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] {2] [3] [4] [3] 


Employees here take full advantage of their grievance and appeal 
rights. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


In my work unit we tell each other the way we are feeling. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] [2] [3] [4] (5] 


V69. 


v70. 


V7i1. 


V72. 


V73. 


V74. 


V75. 


as es ae 


I have all the skills I need in order to do my job. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] {3] [4] [5] 


My pay is fair considering what other places in this area pay for 
the same kind of work. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[2] [2] [3] [4] [5] 
In DS, authority is clearly delegated. 
Strongly Strongly 


Disagree Disagree Undecided Agree Agree 


(1] [2] [3] [4] [5] 


For DS to do its mission well it is necessary for me personally 
to do a good job. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] (3) [4] [5] 


If I have ideas on how people in DS could improve their work 
I should tell them. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] (3] [4] (S] 


My supervisor encourages me to help in developing work methods and 
job procedures. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] {2] [3] [4] [5] 


My supervisor helps me solve work related problems. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


(1] [2] [3] re] (5] 


V76. If I were subject to an involuntary personnel action, I believe I 
would be told about my grievance and appeal rights. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


V77. I have the authority I need to accomplish my work objectives. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [3] 


V78. Quality control programs help me do my job better. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [3] 


V79. I will receive more money if I work harder for DS. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
(1] {2] [3] [4] [3] 


V80. It is necessary for DS to maintain high work quality and timeliness. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


V81. All in all, I am satisfied with my pay. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


V82. I will get a larger pay increase if I perform especially well. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] [2] (3] [4] [5] 


V83. 


V84. 


V86. 


V87. 


V88. 


V89. 


I have too much at stake in my job to change jobs now. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [+] [5] 


Under the present system financial rewards are seldom related 
to employee performance. 


Stroi.gly Strongly 
Disagree Disagree Undecided Agree Agree 
{1] (2] (3] [4] [3] 


I often think about quitting. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] (3] [4] [5] 


My job is challenging. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
{1] [2] [3] [4] [5] 


My pay is fair considering what people in other directorates are 
paid. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


Management is flexible enough to make changes when necessary. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


On my job I know exactly what is expected of me. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


(1] [2] [3] [4] [5] 


¥90. The work I do on my job is meaningful to me. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


V91. I am satisfied with the chances I have to learn new things on my job. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


V92. I am given the opportunities I want to participate in training 


programs. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
(1] [2] [3] Le (5] 


V93. Management and the union are willing to try solutions which haven't 
been tried before. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] (3] [4] (5] 


V94. In my work unit everyone's opinion gets listened to. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


V95. I can save money for DS by working harder or better. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


V96. My supervisor is concerned about me as a person. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] [2] [3] [4] [5] 


v97. I have ideas about how I could do a better job for DS. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] {3} [4] [5] 


V98. Management is only willing to negotiate about a few specific issues. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
(1] [2] [3] [4] (5] 


V99. Iwill have better job security if I perform especially well. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


V100. All in all, I am satisfied with my work unit. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
(1) [2] [3] [4] [5] 


V101. Empioyees do not have much opportunity to infiuence what goes on in DS. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


V102. Competition for jobs here is fair and open. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


V103. I am satisfied with the amount of job security I have. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] (2] [3] {4} [5] 


V104. I would prefer not to receive an arnual periormance 
from my supervisor. 
Strongly 
Disagree Disagree Ur tecided Agree 
[1] [2] [3] [4] 
V105. During the next year I will probably look for a new 
Strongly 
Disagree Disagree Undecided Agree 
[1] [2] [3] (4] 
V106. My own hard work will lead to recognition as a good 
Strongly 
Disagree Disagree Undecided Agree 
[1] [2] [3] [4] 


How satisfied are you with the efforts your union has made 
of the following outcomes for its members? 
V107. More meaningfui work for 
members? 


] Very dissatisfied 
] Dissatisfied 

} Neither satisfied 
] Satisfied 

] Very satisfied 


V108. Fairer job classifications? [1] Very dissatisfied 
{2] Dissatisfied 

{3] Neither satisfied 
[4] Satisfied 

[5] Very satisfied 


V¥109. Fairer promotion policies? Very dissatisfied 
Dissatisfied 
Neither satisfied 
Satisfied 


Very satisfied 


appraisal 


Strongly 
Agree 

[5] 
job ouiside DS. 
Strongly 
Agree 

[3] 
performer. 
Strongly 


Agree 


[5] 


to get each 


nor dissatisfied 


nor dissatisfied 


nor dissatisfied 


V110. 


Tf I 
gain: 


V11l. 
Vil2. 
V113. 


= 49 = 
How satisfied are you with {1} 
the success your union has f2] 
in bargaining non-wage [s 3] 
issues? 14] 

[5] 


took a new job, I would do so to 
(Mark the THREE most important. } 


Very dissatisfied 
Dissatisfied 
Neither satisfied nor dissatisfied 
Satisfied 

Very satisfied 


] More responsibility 
} Better pay 

] More job security 

}] Better supervisors 

] More interesting work 

] More important program 

} Better working conditions 

} More convenicnt office hours 
} Better promotion opportunities 
} More congenial colleagues 

] Better geographical location 
] Better benefits , 


Please indicate how important each of the fullowing is in determining 
your pay: 


V1i4. 


V1l6. 


Vil7. 


The quality of your job performance? 


The quality of your work unit's 
performance? 


The amount of responsibility on your [| 


job? 


Your length of service? 


Not important at all 
Somewhat important 
Important 

Very important 
Extremely important 


WE WhN Ee 
eS 


1] Not important at all 
2} Somewhat important 
3] Important 

4) Very important 

5] Extremely important 


Sa 


] Not important at all 
J] Somewhat important 

] Important 

] Very important 

] Extremely important 


} Not important at all 
, Somewhat important 

} Important 

} Very impertant 

] Extremely important 


V118. Would you be willing to serve as a [1] Yes 
member of a union-management [2] No 
committee? 
V119. Please rate the amount of effort [1] No effort 
you put into work activities [2] A little effort 
during an average workday. [3] Some effort 


A lot of effort 
[5] Extreme effort 


How important is each of the following to you: 


V120. Challenging work responsibilities? 1] Not important at all 
Somewhat important 
Important 
Very important 
Extremely important 


V121. The chance to accomplish something {1} Not important at all 
worthwhile? [2] Somewhat important 
Important 


Very important 
Extremely important 


V122. The chance to learn new things on {1} Not important at all 
on your job? [2] Somewhat important 
[3] Important 
Very important 
{5] Extremely important 


Vi23. Getting a feeling of accomplishment {1] Not important at all 
from your job? [2] Somewhat important 
Important 
Very important 
Extremely important 


V124. Retirement benefits? Not important at all 
Somewhat important 
Important 

Very important 
Extremely important 


Wm &WDhY Be 


¥V125. Your chances for getting a {1] Not important at all 
promotion? [2] Somewhat important 
{3] Important 
[4] Very important 
[5] Extremely important 


V126. The amount of job security you {1] Not important at all 
have? 2 Somewhat important 
Important 


Very important 
{5} Extremely important 


V127. Your chances for obtaining a [1] Not important at all 
permanent "career" position? {2] Somewhat important 
[3] Important 
{4] Very important 
[5] Extremely important 


V228. If I need help with a decision I have to make I receive the 


help. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] [2] {3] [4] [5] 


V229. Decisions here result in the overall mission support of DS. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] [2] [3] [4] [5] 


V230. DS management aliows me to effectively use the knowledge I have 
gained after attending classes. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] [2] {3] [4] [5] 


V231. I have had an opportunity to participate in a quality circle, 
process action team, or task force. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


{1] [2] (3] [4] [5] 


V232. -Quality circles, process action teams, and task forces allow me 
to share my ideas and help improve the work processes. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
(1] [2] [3] [4] [5} 
*V233. Team building is stressed in day-to-day operations. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] (3] [4] [5] 
*V234. Team building and communications training have improved my 
working relationship with my supervisor. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 
V235. I believe that employees who practice a participative type of 
management or behavior are the ones who are promoted. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
(1] [2] [3] [4] [5] 
*V236. My division has supported the team building effort. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
(1] [2] [3] [4] (5] 
V237. My supervisor shares organizational performance data with me. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 
*V238. Team building and communications training have improved my 


working relationships with my peers. 


Strongly 
Disagree 


Strongly 


Disagree Undecided Agree Agree 


{1] {2] (3] [4] (5] 


V239. I have an opportunity to regularly share my ideas on mission 
related issues regarding decisions for improving timeliness, 
quality, and production. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


(1) [2] [3] [4] [5] 


*V240. Team building classes in DS have helped communication between 
divisions/sections. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


(1) [2] [3] [4] [5] 


I believe managenent wants to hear my ideas/opinions concerning 
attendance problems, staffing requirements, DS procedures, and 
plans. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1} [2] {3} [4] [5] 


When hiring new employees, I believe management is selecting 
participative type employees. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


(1) [2] [3] [4] [5] 


There is enough staffing flexibility to support supervisory 
job assignments and the definition/creation of supervisory 
positions. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


(1] [2] (3] (4] (5] 
IF YOU ARE NOT A SUPERVISOR, PLEASE SKIP TO PAGE 28. 
ANSWER SECTION 3, BEGINNING WITH QUESTION 170 (V151). 


IF YOU ARE A SUPERVISOR, PLEASE COMPLETE BOTH SECTION 2 AND 
SECTION 3, BEGINNING ON THE NEXT PAGE. 


Vi2z8. 


V129. 


V130. 


V131. 


V132. 


V135. 


SUPERVISORS SHOULD COMPLETE THIS SECTION 
SECTION 2: SUPERVISORS’ ATTITUDES 


it takes too long to get decisions made in DS. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] [2] (3] [4] [5] 


My pay is based partly on the performance of the workers I supervise. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] [2] [3] [4] [5] 


The work I am responsible for supervising probably could be done with 
fewer employees. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] [2] [3] [4] [5] 

There is enough staffing flexibility to meet changing work loads. 
Strongly Strongly 
Disagree Disagree Undecided Agree Agree 

[1] [2] [3] [4] (5] 

I have enough authority to hire competent people when I need them. 

Strongly Strongly 


Disagree Disagree Undecided Agree Agree 


(1) [2] [3] [4] (5] 


Top management generally supports the personnel decisions made by 
supervisors in DS. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] [2] [3] [4] [5} 


V134. 


Vi35. 


V136. 


V137. 


V138. 


V139. 


Viso. 


In DS jobs are classified fairly and accurately. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


Without performance appraisal it would be more difficult to reward 
or discipline employees. 


Strongly Strongly 


Disagree Disagree Undecided Agree Agree 


[1] [2] [3] [4] [5] 


The criteria used to grade supervisory positions in DS are fair. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


The personnel office helps me perform my job effectively. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] (3] [4] [5] 


My pay level is based partly on the number and grades of the people 
I supervise. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] [2] [3] [4] [5] 


It takes too long to process the paperwork needed to fill 
vacancies here. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] [3] [4] [5] 


Supervisors here cooperate with each other for the attainment of 
DS's goals. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


{1] (2] [3] 4 (3] 


I have enough authority to determine my employees’ pav. 
& y y ploy pas 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] (2] (3} {+] {54 


In DS, my organization recognizes supervisors who take the time to 
develop their subordinates’ knowledge, skills, and abilities. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] [2] [3] [44 [5] 


The personnel department here provides line management with valuable 
Support services. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] [2] [3] [4] [5] 


The work I am responsible for supervising probably could be done with 
fewer mid-level supervisors. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


(1] [2] [3] [4] [5] 


have to devote too much time to position classification. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


[1] [2] {3] [4] [5] 


have enough authority to promote people. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


(1] (2] [3] [4] [5] 


The current system enables me to help the people I supervise 
improve their performance. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 


{1] [2] [3] [4] (3] 


V148. 


V149. 


V150. 


V267. 


V166. 


V167. 


I have enough’ authority to influence classification decisions. 


Strongly 
Disagree Disagree Undecided 
[1] [2] [3] 


Agree 
[4] [5] 


Strongly 
Agree 


Supervisors in DS feel their ability to manage is restricted by 


unnecessary personnel rules and regulations. 


Strongly 
Disagree Disagree 


[1] [2] [3] 


Undecided 


Agree 


[4] [5] 


Strongly 
Agree 


I have enough authority to remove people from their jobs if they 


perform poorly. 


Strongly 
Disagree Disagree 


(1) [2] [3] 


Undecided 


Agree 
[4] [5] 


Strongly 
Agree 


DS backs me as a supervisor when I make a decision. 


Strongly 
Disagree Disagree 


[1] [2] (3] 
How long have you been officially 


designated a supervisor (any level)? 


How many employees do you supervise 
directly (not at second level)? 


Undecided 


Agree 
[4] [5] 


Strongly 
Agree 


Less than 1 year 
1 - 2 years 

2 - 5 years 

Over 5 years 


None 
Lise 2 
3.25 
6-9 
10 - 20 
21 - 30 


More than 30 


PLEASE GO TO QUESTION 170 (V151) ON PAGE 28. 


EVERYONE SHOULD COMPLETE THIS SECTION. 


SECTION 3: BACKGROUND 


THE INFORMATION COLLECTED IN THIS S 


WILL ONLY BE USED TO HELP SUMMARIZE THE SURVEY DATA. 


ECTION 


INDIVIDUALS WILL NOT BE IDENTIFIED. 


Vi51. What is your office symbol (e.g., DSTEW)? 


(office symbol) 


V152. How long have you worked in DS? {1] 


*V272. What is your pay schedule {1] DH1 [5] 
and pay level? {2] DH2 
[3] DH3 
{4] DH4 [8] 
**V156. What is your pay category? [1] GS {3] 
] GM [4] 
[5] 
**V157. What is your pay grade? {1] 1 [6] 6 
{2} 2 ie aes 
[3] 3 8] 8 
[4] 4 9] 9 
{5] 5 {10] 1 
V158. Before PACER SHARE, how long had [1] 
you been in your last paygrade {2} 
(e.g., WGS)? [3] 
[4] 


{Year One comparison sites wording: "How long have 
present grade or pay level?"] 


Less than 1 year 


1 - 3 years 
3 - 5 years 
Over 5 years 


DW1 

DW2 

DW3 (11] 

DW4 [12] 

WG 

WL 

ws 
(aig tt 
[42]. 42 
[13] 13 
[14] 14 

0 [15] 15 


DxX1 
DX2 
DX3 
DX4 


Less than 1 year 


1 - 2 years 
2 - 5 years 
Over 5 years 


you been in your 


V159. 


V160. 


V161. 


V162. 


V163. 


V164. 


What type of appointment are {1] 
you serving under? 2] 


How long have you worked for your 
present immediate supervisor? 


How many years have you been a Federal 
Government employee? (Exclude 
military service.) 


How many years of full-time employment 
have you had in the private sector? 


How many times have you moved between 
Federal agencies in the last 10 
years? (Count different major DoD 
components as different agencies.) 


Demonstration on-call (DOC)* 
Temporary/term appointment 
Probationary career conditional 
Career conditional 


Career 
Other 


[1] 
[2] 
[3] 
[4] 
[5] 
[6] 


[1] 
[2] 


0 - 3 months 
3 - 6 months 
6 months to 1 year 
1 - 2 years 
2-5 years 
Over 5 years 


Less than 1 year 
1 - 3 years 

4 - 9 years 

10 - 14 years 

15 - 29 years 

30 years or more 


None 

Less than 1 year 
1 - 2 years 

2 - 5 years 

Over 5 years 


Never 
Once 
Twice 
Three or more times 


What is your job process number and process title (e.g., DW-9200, 


Distribution Process)? 


and 


(job process no.) (job process title) 


{Comparison site wording: "What is your job series number and 


job title?"] 


V165. Are you currently a member of a local union [l] Yes 
representing DS employees? [2] No 
V168. How old were you on your last [1] Under 30 [4] 50 - 54 
birthday? [2] 30 - 39 [5) 355 - 59 
{3] 40 - 49 [6] 60 and over 
Vi6é9. Are you male or female? {l1] Male 
{2] Female 
V170. Are you Black, White, or Other (e.g., [1] Black 
American Indian, Eskimo, Aleut, Asian, {2 white 
or Pacific Islander)? [3] Other 
V171. Are you of Hispanic origin or {1} Hispanic origin 
non-Hispanic origin? [2] Non-Hispanic origin 


vV172. What is your education level? (Indicate highest grade completed.) 


{1] Elementary school (grades 1-8) 
[2] Some high school or some technical training 
{3] GED (General Educational Development) 
Graduated from high school and received regular high school diploma 
[5] High school degree plus technical training or apprenticeship 
[6] Some college 
Two-year associate college degree 
Four-year college degree (B.A., B.S., or other bachelor’s degree) 
Some graduate school 
{10] Master's degree 
[11] Doctorate degree (Ph.D., M.D., J.D., etc.) 


V153. Have you ever been a [1] Yes --> (Answer Q #187 (V154) next) 
regular member of a {2] No --> (Answer Q #189 (V173) next) 
quality circle at DS? 


V154. Are you in quality {1] Yes --> (Answer Q #188 (V155) next) 
circle now? [2] No --> (Answer Q #189 (V173) next) 
Vi55. How long have you been in this [1] 0 - 3 months 
quality circle? [2] 3 - 6 months 


{3} 6 months to 1 year 
[4] 1 - 2 years 
[5] 2 - 5 years 

} Over 5 years 


*V173. 


*VL174, 


*VA175. 


*V176. 


I have been adequately informed about the PACER SHARE 
demonstration project. 


Strongly Stron 


Disagree Disagree Undeciaed Agree Ag 
( 


[1] [2] (3] [4] 


I understand how PACER SHARE will affect me and my work. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
(1] [2] [3] (+) [5] 


I am in favor of the PACER SHARE demonstration project. 


Strongly Strongly 
Disagree Disagree Undecided Agree Agree 
[1] [2] (3] [4] {5] 


Are there any other issues about PACER SHARE that should be 
addressed in future surveys? 


THANK YOU FOR COMPLETING THIS SURVEY. 
WE APPRECIATE YOUR COOPERATION. 


Appendix B 


SUPPLEMENTAL SURVEY RESULTS 


This appendix presents supplementary information pertaining to the 
first-year attitude survey. Table B.1 shows the mean response among 
nonsupervisors for each question in the questionnaire, by Air Logistics 
Center (ALC). Table B.2 shows the comparable results for supervisors. 
Table B.3 gives the nonsupervisors’ means for the response scales 
discussed in Sec. II of R-3945-FMP. Table B.4 presents the analogous 
results for supervisory personnel. 

The Ordinary Least Squares (OLS) regression results are shown in 
Tables B.5 to B.11. Recall that in these tables, the Sacramento 
baseline mean is listed in column one; the other ALCs' baseline mean 
equals column one minus column two; their first year mean is column one 
minus column two plus column three; and the Sacramento year one mean is 
column one plus columns three and four. Table B.5 presents results for 
questions 1 through 127, which were answered by all respondents. Table 
B.6 shows results for the response scales based on these questions. 
Table B.7 presents results for questions 128 through 150, which were 
answered by supervisors, and for the response scales based on these 
questions. Table B.8 contains the regression results for the attitude 
scales when controlling for responses to scale OPMI8D. Table B.9 
contains the regression results for the new variables added to the year 
one survey. Table B.10 contains the corresponding results for the three 
groups of these variables before controlling for responses to OPM18D. 
Table B.11 shows the corresponding group results after controlling for 
responses to OPM18D. As discussed in Sec. II of the report, the purpose 
of the regression analyses is to determine the extent to which the mean 
work force response at SM-ALC differed from that of the comparison ALCs, 
controlling for differences in the demographic composition and 
experience base of their respective samples and work forces. The 
following discussion describes the background factors included in the 


analyses and their purposes. 


The "SUPER" variable is coded "1" for supervisors and "0" for 
nonsupervisors. The coefficient thus indicates the difference in mean 
response for supervisors relative to nonsupervisors. For example, as 
can be seen on the first page of Table B.5, the mean response for 
supervisors across all the ALCs was .14 higher (on the five-point scale) 
for question 1. The "SACTO" variable is coded "1" for SM-ALC 
respondents and "0" for all others. It is a key variable, indicating 
the baseline difference in the mean response for SM-ALC relative to the 
comparison group. A second key variable is "FOLUP1,” which indicates 
the systemic change in mean response during the first year of PACER 
SHARE for the comparison group. It is coded "1" for first year and "0" 
for baseline. The primary variable for the year one evaluation is 
"FOLPSACT." This indicates the extent to which the change in mean 
response at Sacramento differed from the change at the other ALCs 
(FOLUP1). (Thus, the total change at Sacramento during the first year 
of PACER SHARE equals FOLUP1 + FOLPSACT.) FOLPSACT is coded "1" for 
first-year Sacramento and "0" otherwise. 

"V152" (or YRSDS) indicates tenure in DS and is coded as indicated 
in the questionnaire. A higher value reflects longer time in DS. 
"V1i56W" (COLLAR) is coded "1" for white-collar job holders and "0" for 
blue-collar job holders. "V157C" (PAYGRADE) indicates pay bands 1 - 4 
as defined in PACER SHARE and discussed earlier. Higher values reflect 
higher pay bands. "V159A" (APPTTYPE) is coded "1" for career category 
"career' employees and "0" for all others. "V160" (UNDERSLP) indicates 
length of time worked for current supervisor and is coded as indicated 
in the questionnaire. Higher values reflect longer times. "V161" 
(YRSFEDGV) indicates length of time employed by the federal government 
and is coded as indicated in the questionnaire. Higher values reflect 
longer times. "V165" (UNION) is coded "1" for union members and "2" for 
nonmembers. "V168" (AGE) reflects the respondent's age and is coded as 
indicated in the questionnaire. Higher values indicate older 
respondents. "V169" (SEX) is coded "1" tor males and "2" for females 
"V¥172" (EDUC) reflects education levels and is coded as indicated in the 


questionnaire. Higher values reflect more education. The remaining 


variables are dummy variables reflecting race and ethnicity. "wHS" is 
white Hispanic; "BLK" is black; "OTH" represents all other persons not 


classified as white non-Hispanic. 
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Appendix C 


ATTITUDE RELATIONSHIPS AND STRUCTURES 


It is helpful to observe the relationship among attitudes; with 
such knowledge, given a change in one set of attitudes, we can predict 
changes in related sets of attitudes. Also, placing changes in 
attitudes into larger frameworks and ensuring that these frameworks have 
an acceptable degree of integrity allows us to more easily interpret the 
changes in attitude that we observe. 

Accordingly, we undertook to (1) observe the relationships among 
the attitudes measured in this study, and (2) identify a larger 
framework for them. In this appendix, we discuss the methodology used 
to establish correlations among the attitude scales and the larger 
analytical framework into which these scales could be placed. We 
examined the baseline scale relationships observed at Sacramento and 
compared them with those at the other sites to verify their overall 
consistency. We then made comparisons between the sites at year one to 
view the changes, if any, in these relationships and the structures they 
make up. In addition, we examined some items (variables) newly added to 
the questionnaire to verify that they fall within the broader attitude 


dimensions they were intended to measure. 


BACKGROUND 

As described earlier, we measured attitudes both at baseline and 
the first year follow-up using scales (groups of questionnaire items). 
These sets of attitudes represented by the scales are themselves part of 
a larger attitudinal structure. “Thus, in the same way that variables 
can be grouped into scales to gauge attitude areas more reliably, scales 
can be grouped according to the larger attitude dimensions they measure. 
These larger dimensions are termed attitude factors. 

If we can identify the scale composition of these larger 
attitudinal factors, we will have a way of analyzing attitude changes 


within a broader perspective, i.e., one that will aliow us to observe 
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basic trends rather than trying to sort out the meaning of a number of 
changes in individual measures (in this case, the scales). It is easier 
to examine and make sense of changes in four or five basic attitude 
concepts than it is with 30. 


Thus the problem is: 


° to identify these lerger, or underlying, factors; 

. to verify that these factor structures (the way employees 
viewed their work environments) were the same at Sacramento and 
the other sites (i.e., were consistent) at baseline; and 

° to observe the changes (if any) in the composition of these 
factor structures over time in order to validate their 


continuing applicability as underlying attitude constructs. 


These problems translate directly into the processes listed below. 


1. Performing a preliminary analysis by examining the predictive 
relationship among the scales, i.e., seeing the extent to which 
the presence of one set of attitudes (a scale) would predict 
the presence of another set (another scale). 

2. Identifying the appropriate scale groupings that would 
constitute a factor, i.e., determine “ts structure. 

3. Observing the consistency of these factor structures across 


sites and over time. 


We discuss the processes and results of these steps below. 


Identifying Relationships Among Scales 

To identify the most closely related scales, we performed a 
preliminary examination of their predictive relationships, i.e., the 
extent to which the presence of one set of attitudes (on a given scale) 
would predict the presence of another set of attitudes (on another 
scale) and then checked to see if these relationships were stable across 


sites and over time. 


Sasa tnnemmeneteineeneneetenneminmeememeeeser een eneeeemeen meme es ee 


To observe these relationships, forward stepwise ordinary least 
squares (OLS) regressions were conducted on Sacramento data and 
comparison-site data for both baseline and follow-up. The baseline 
relationships were analyzed first to determine if the predictive 
relationships (associations) among the scales were similar across sites, 
thus helping to verify their consistency and applicability. Next, we 
wanted to observe whether these relationships were maintained during the 
first year of the demonstration, and therefore performed the same 
regression analysis at follow-up. The results of these regressions are 
shown in Table C.1. The left-hand side of Table C.1 shows the 
cumulative and total R? at baseline! for the analyzed scales at 
Sacramento and the other sites; the right-hand side of Table C.1 shows 
this information for Sacramento and the other sites at year one. 

Because the first two or three predictor scales that are observed to be 
associated with the outcome scale during the regression analyses tend to 
account for most of the prediction, for simplicity only those scales 
contributing at least .05 to the total R? are shown. The total R? is 
based on the inclusion of all predictor variables significant at the p < 
.05 level. 

For example, consider the baseline results for Sacramento. For the 
first scale in Table C.1, OPM02, we see that the most predictive scale 


is OPM15, which yields an R? of .32. If we add the effect of OPM06, the 


R? increases to .43. The total R?--based on including all scales with 


regression coefficients significant at the p < .05 level--is only 
slightly higher, at .49. Thus the attitudes measured by OPM02, 
Satisfaction with Control Over Work, are most strongly related with the 
attitudes assessed by OPM15, Organizational Climate, and OPM06, 
Satisfaction with General Supervision/Direction. 

An examination of the regression results shown in Table C.1 
indicates that the baseline predictive scales at the comparison sites 
were extremely similar to those at baseline at Sacramento. In 


approximately four of every five cases, the scales that predicted a 


‘Measures of the degree to which the answers on the various scales 
affected each other. 
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given scale at Sacramento were the same as those at the other ALCs.? 
Further, we can observe that these predictive relationships remained 
essentially stable at both Sacramento and the other sites during the 


first year of PACER SHARE. 


identifying Factor Structures 

To examine the existence of broader underlying attitude dimensions 
that would facilitate the interpretation of attitude patterns and 
changes, we conducted a principal factor analysis (with orthogonal 
rotation) to group the attitude scales by the patterns of their 
responses. In essence, this type of analysis groups scales that were 
answered similarly by individual survey respondents and distinguishes 
them from scales whose responses were independent of these answers. 
Thus, the resulting scales that are shown to be the most closely 
affiliated with each other-~the factors--are the sets of attitudes that 
affect and are affected by each other to the greatest extent. The 
scales that are highly correlated with each other compose a larger 
attitude factor. We can then identify and name this underlying attftude 
factor according to the type of scales that compose it. 

We began by analyzing the factor structure at Sacramento at 
baseline. The criterion for placing a particular scale on a factor was 
a factor-loading coefficient of |.5| or higher. We did not assign 
scales to more than one factor: scales that had comparable loadings on 
several factors (and thus had no distinguishing loading on any one 
factor) were not assigned to any single factor. 


Our analysis revealed five basic attitude factors: 


° Satisfaction with Supervision and Co-worker Interactions; 


° Overall Work Satisfaction; 


?This figure (4/5) was derived by counting each instance of a match 
or mismatch for the variables listed for both Sacramento and the other 
ALCs. 


- 302 - 


° General Pay Satisfaction; 
: Reward System Satisfaction; and 


. Reward Importance. 


These factors, and their associated scales, are shown in Table C.2. 


Observation and Comparison of Changes in Factor Structures 

To verify the consistency of the factor structures between sites, 
it was necessary to compare the scale groupings within factors between 
Sacramento and the other sites to see if the scales were grouped in the 
same ways. To observe whether there were any changes in these 
Structures over time, we compared the factor structures at baseline and 
follow-up for Sacramento and the comparison sites. 

Cronbach's alpha coefficient was computed on each of the five 
attitude factors to assess the degree of correlation among the scales 
defining the factor. These computations were performed for Sacramento 
and the other ALCs at baseline and follow-up. The alpha coefficients 
are shown in bold in Table C.2. The factor loadings of each scale-- 
which can be thought of as the degree to which the scale correlated with 
that factor--are listed below the overall factor alpha coefficients. 

The groupings shown in Table C.2 enable us to assess (1) whether 
the structures of the factors differed between Sacramento and the other 
ALCs and (2) whether these groupings changed over the first year of 


PACER SHARE. An examination of Table C.2 reveals that: 


The scale groupings were almost identical at baseline for 
Sacramento and the comparison sites, indicating that the 
underlying attitude structures (the factors) were similar and 
hence highly comparable throughout the system. These 
structures did not change much during the first year,’ 
indicating that the overall framework for discussing the 


attitude changes within tuat structure was still intact; and 


7Although the factor loadings changed somewhat, we note that these 
changes are minor and do not represent major shifts in attitude 
Structure (as would be signaled by the addition or deletion of scales on 
a factor). 
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With the exception of reward importance--a factor produced 
partially by similar wording of the component questions--the 
factors exhibit generally high alpha coefficients fi.e., stron 
interrelationships among the constituent variables) and do not 
change much between baseline and follow-up. The 
interrelationships among the attitudes embodied by each factor 


remained strong and stable in their composition. 


Thus, the attitude patterns at the various sites had a common underlying 
structure (factors) both at baseline and the year one follow-up, and we 
are therefore able to use these factors as common reference points to 
help us interpret the changes in ratings for scales and variables that 


we observe. 


MISCELLANEOUS WORK ENVIRONMENT PERCEPTIONS 

As mentioned earlier, some scales were not assigned to the factors 
listed above because they did not have a loading factor of at least |.5] 
on any single factor at Sacramento at baseline. Their loadings are 
presented in Table C.3 to illustrate how the/r influences were spread 
among the various factors. For example, scale OPM02, Control Over work, 
is spread mainly between three factors: Satisfaction with Supervision 
and Co-worker Interactions, where the scale loading at baseline at 
Sacramento is .48; Reward System Satisfaction, where it is .37; and 
Overall Work Satisfaction, where it is also .37. Again, we see only 
minor changes in these scale loadings according to time (baseline vs. 


follow-up) and piace (Sacramento vs. other sites). 


OVERVIEW OF BROAD CHANGES IN SCALE FACTORS 

Table C.4 provides an overview of results of regression analyses 
performed for the factors, which correspond to those shown in Table C.7 
for the scales and individual questionnaire items. Column one indicates 
the Sacramento baseline mean rating for the factor. Column two shows 
the baseline Sacramento regression coefficient for the factor, i.e., the 


estimated difference between the Sacramento score for that factor and 
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the average score across the other ALCs, correcting for 


demographic/survey sample differences. Column three shows the amount of 
change in the average score at the other ALCs at follow-up. Column four 
indicates the difference between the amount of change in Sacramento 
follow-up scores as compared to the average amount of change at the 
other sites. Column five presents this difference when responses to 
OPM18D (the scale measuring perceptions of the link between pay and 
performance) are controlled for. 

For example, an examination of the first of the five basic attitude 
factors, Satisfaction with Supervision and Co-worker Interactions, shows 
that the baseline mean scores for the scales within this factor at 
Sacramento averaged 2.84, which was .22 below the mean scores at the 
other ALCs after correcting for population differences. Column three 
shows there was no change in the mean score at the comparison sites 
after the first year. The first-year change at Sacramento was only +.03 
higher--as seen in column four--not a significant difference. However, 
when we correct for the effects of perceptions of the pay-performance 
link (scale OPM18D), we observe a significant change in the last column: 
Sacramento attitudes toward supervision and co-worker interactions now 
show a significant improvement relative to the other ALCs (+.13) for 
this factor during the first year of PACER SHARE. As seen in Sec. II, 
at the scalar level, this indicates that Sacramento respondents’ 
perceptions of the link between pay and performance had a significant 
depressing effect on their perceptions assessed on the supervision and 
group interaction satisfaction factor, and that when we make allowances 
for this effect, the perceptions assessed by thic factor improved at 
Sacramento Significantly during the first year of PACER SHARE relative 
to the comparison sites. 

Overall, we observe from Table C.4 that (1) attitudes toward pay 
and the reward system were the least favorable; (2) attitudes at 
Sacramento at baseline were generally more negative than at the other 
ALCs; (3) during year one, attitudes did not change much across the 
system; (4) this alse was true for Sacramento attitudes that were not 


financially oriented, whereas financially oriented attitudes worsened 
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significantly; and (5) when we adjust for the effect of perceptions of 
the pay-performance link, we find that attitudes toward supervision and 
co-worker interactions improved significantly relative to the other 
ALCs, and there was also a significant swing in overall work 


satisfaction. 


ANALYZING PREDICTIVE RELATIONSHIPS AMONG FACTORS 

In addition to defining basic underlying attitude dimensions 
(factors), we would like to understand the extent to which the attitudes 
found within each factor correlate with the attitudes found in the other 
factors. This would enable us to see linkages between attitudes more 
clearly. To view the relationships among the factors, we performed 
regressions upon the factor scores. In Table C.5, the numbers listed in 
bold show the total R?, the amount of variance in a given factor that is 
accounted for by the other factors. For example, we see that 53 percent 
of the variance in the factor labeled Satisfaction with Supervision and 
Co-worker Interactions can be explained by responses on the other 
factors. 

The regression coefficients for each of the predictor factors are 
listed below the ke amounts and indicate the relative degree of effect 
that responses on these factors have on the outcome factor. For 
example, we see that in the prediction of Satisfaction with Supervision 
and Co-worker Interactions, the factors of Reward System Satisfaction 
and Overall Work Satisfaction are the two most influential. We also 
obse:ve that attitudes concerning General Pay Satisfaction and Reward 
Importance Fave far less influence. Note that the above relationships 
are not necessarily causal: It may be that Supervision Satisfaction 
drives Work Satisfaction, rather than vice-versa. Note also the 
importance of attitudes toward advancement in shaping attitudes toward 
supervisors and co-workers, consistent with the earlier discussion in 
Sec. III of the report. 

In predicting the factor of General Pay Satisfaction, the factors 
of Reward System Satisfaction (beta = .38) and, interestingly, Overall 


Work Satisfaction (beta = .31) exhibit the two hignest scores. The 


Table C.5 


RELATIONSHIPS AMONG ATTITUDE SCALE FACTORS 


Total R2 
Factor Regression Coefficients 


SATISFACTION WITH SUPERVISION AND 
CO-WORKER INTERACTIONS 


Overall Work Satisfaction 
General Pay Satisfaction 
Reward System Satisfaction 
Reward Importance 


OVERALL WORK SATISFACTION 


Satisfaction with Supervision 

Co-Worker Interactions 
General Pay Satisfaction 
Reward System Satisfaction 
Reward Importance 


GENERAL PAY SATISFACTION 


Satisfaction with Supervision 

Co-Worker Interactions 
Overall Work Satisfaction 
Reward System Satisfaction 
Reward Importance 


REWARD SYSTEM SATISFACTION 


Satisfaction with Supervision 

Co-Worker Interactions 
Overall Work Satisfaction 
General Pay Satisfaction 
Reward Importance 


REWARD IMPORTANCE 


Satisfaction with Supervision 
Co-Worker Interactions 
Overall Work Satisfaction 
General Pay Satisfaction 
Reward System Satisfaction 


4 Coefficients are significant at the p < .05 level. 
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observed affiliation between Work Satisfaction and Pay Satisfaction is 
not something we would expect, but is indicative of the way in which 
economic issues seem to have affected a variety of attitudes in 
Sacramento. This finding reflects the observations we made concerning 
Table 17 of R-3943-FMP, which outlined the effects that perceptions 
about the link between pay and performance (as found in scale OPM18D) 
had on seemingly nonrelated attitudes. 

The factor dealing with Reward Importance has a low R? of .03, 
indicating that its scale responses are relatively unrelated to the 
responses on its companion factors. This is primarily because the 
scales affiliated with Reward Importance measure a different type of 
response than the scales of the other factors: Reward Importance 
attitudes are measures of internal values (the importance of job 
security, rewards, etc.) while the other factors reflect measures of 


external perceptions. 


FACTOR STRUCTURE OF NEW ITEMS 

Sixteen new items were added to the Sacramento questionnaire after 
the baseline survey (see Sec. II). The purpose of these new items was 
to measure additional attitudes concerning changes made as part of PACER 


SHARE. The items concerned: 


° attitudes toward team building; 
° attitudes toward information use and feedback in the workplace; 
and 


° attitudes toward quality circles. 


Our analyses of these new variables investigated whether they would 
group into the three areas they were intended to assess. This was 
verified by conducting a principal factor analysis on the new variables 
(questionnaire items) to determine their factor structure. They were 
grouped onto a factor if they had a factor-loading coefficient of |.5| 
or higher on that factor and had no other similar loadings. After the 


variables for each factor were identified, Cronbach's alpha coefficient 
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was computed for each of the factors to assess the total correlation of 
all of its variables. Table C.6 indicates the resulting factors, their 
constituent variables, and factor loadings. The degree of overall 
correlation of the variables on each factor, measured by Cronbach's 
alpha, is shown in bold. 

There are high alpha coefficients for Team Building, .85, and for 
Information Use/Feedback, .81. The Quality Circle alpha coefficient was 
lower, .52, because there were only two items in the factor, and they 
were slightly different in wording: opportunities to participate in a 
quality circle are not the same as being allowed to share one's ideas 
about work processes. However, the two items did correlate well enough 
to be extracted as a factor. Thus, the factor analysis supports the 
structure intended by Sacramento in adding these questions. 

Note that one item, V237, did not load cleanly on any of these 
factors, but rather was split between two factors. Another item, V235, 
did not correlate highly to any of the three factors. Accordingly, 


these two variables were treated as independent. 


ALC DIFFERENCES IN NEW FACTOR SCORES 

Using follow-up data, regression analyses were run on two of the 
new question factors and the two "independent" items to determine if the 
responses to these areas differed significantly between Sacramento and 
the comparison sites,“ and also if they were affected by the negative 
Sacramento perceptions about pay and performance. These regressions are 
shown in Table C.7. Sacramento respondents tended to be dissatisfied 
with information use/feedback and sharing of organizational performance 
data. In contrast, they expressed satisfaction with quality circles. 
Sacramento respondents expressed significantly less satisfaction than 
those at the other ALCs except concerning quality circles, where they 
expressed greater satisfaction. After controlling for perceptions of 


the pay-performance link, attitudes were generally comparable to those 


“Because the "team-building" factor items were tested only at 
Sacramento and not at the other ALCs, site comparisons on this 
particular factor were not possible. 


Factor 
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Table C.6 


FACTORS UNDERLYING RESPONSES TO NEW VARIABLES: 


FACTOR LOADINGS AND ALPHA COEFFICIENTS? 


Variable Item 


TEAM BUILDING 


V233 
V234 


V236 
V238 


v240 


Team building stressed in day-to-day operations. 
Team building/communications training has improved 
working relationship with supervisor. 

Division has supporte*? team building effort. 

Team building/communications training has improved 
working relationship with peers. 

Team building/communications training has helped 

communication between divisions/sections. 


INFORMATION USE/FEEDBACK 


V228 
V229 
v230 
V239 
V241 
v242 


v243 


QUALITY 


V231 


V232 


If I need help with a decision, I receive help. 

Decisions result in overall mission support of DS. 

DS management allows use of knowledge gained after 
attending classes. 

I have opportunity to regularly share ideas on 
mission related issues. 

I believe management wants to hear my ideas on 
supervisory issues. 

When hiring, I believe management is selecting 
participative type employees. 

Enough staffing flexibility to support supervisory 


job assignments, creation of supervisory positions. 


CIRCLES 


I have opportunity to participate in a quality circle, 


process action team, or task force. 


Quality circles (etc.) allow me to share my ideas and 


help improve work processes. 


Other Items: 


V237 


v235 


Alpha 
Loadings 
.85 


.67 
73 


.58 
.71 


65 


.81 
56 
-53 
-61 
59 
. 60 
-49 


.50 


-52 
. 68 


56 


My supervisor shares organizational performance data with me. 


Item V237 is split between two factors. 
(Loading on TEAM BUILDING = .46) 
(Loading on INFORMATION USE/FEEDBACK = .50) 


Employees who practice participative type management, 


behaviors are ones who are promoted. 


Item V235 does not logically fit into any of the above factors. 


(Highest loading on INFORMATION USE/FEEDBACK = .32) 


@ values in bold are Cronbach’s alpha for each factor. 


at the other ALCs, except concerning quality circles, where Sacramento 


respendents expressed significantly greater satisfaction. 


Tables C.8 through C.10 provide supplemental information for the 


attitude factors. Table C.8 provides OLS regression results 
corresponding to those shown for the attitude scales in App. B. Table 
C.9 repeats these analyses, controlling for responses to scale OPM18D, 
concerning the perceived link between pay and performance. Finally, 
Table C.10 shows the results of regressing each of the five factors on 


the four others. 


- 315 - 


Table C.7 


REGRESSION RESULTS FOR NEW VARIABLE ATTITUDE SCALE FACTORS: 


YEAR ONE FOLLOW-UP DATA 


Sacramento 
Year One 
Mean 
Factor Variable Item Rating 
INFORMATION USE/FEEDBACK 2.73 
QUALITY CIRCLES 3.37 
Other items: 
V235 Employees who practice 2.89 


participative type management, 
behaviors are ones who are promoted. 


V237 My supervisor shares 2.61 
organizational performance 
data with me. 


Regression Coefficient 


Sacramento 
Year One 
Difference 
From Other 
ALCs 


-.224 


-.1864 


Sacramento 
Year One 
Difference 
With OPM18D 
Controlled 


+.494 


-.084 


NOTE; Factor TEAM is not included because "team building" questions 


were asked at SM-ALC only. 


4 Coefficients are significant at the p < .05 level 
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Appendix D 


ADDITIONAL RESULTS FOR PERSONNEL MEASURES 


This appendix presents mean rates and OLS regression results for 
the personnel measures discussed in Sec. IV of R-3943-FMP. Table D.1 
shows pay rates by pay band for the ALCs at the end of year one. Table 
D.2 shows the regression results for the pay rates in Table D.1. The 
form of the regressions is discussed below. Table D.3 shows supervisor 
percentages by ALC for year one. Table D.4 shows regression results for 
the supervisor measures in Table D.3. Table D.5 shows the total 
supervisor percentage by division for the ALCs. The regression results 
for these percentages are contained in Table D.6. Table D.7 shows the 
percentage of the work force composed of career employees by pay 
schedule and ALC at the end of year one. The regression results are 
shown in Table D.8. 

The model used in the regressions is the same in each case. The 
reference group (intercept) represents the CY 1987 level for the 
comparison ALCs. The "SMBS" coefficient indicates how the baseline 
level at SM-ALC differed from the reference group's. It is coded "1" 
for Sacramento baseline and "0" otherwise. Similarly, the "SMDM" 
coefficient indicates how the first-year SM-ALC level differed from the 
reference group's (baseline level). It is coded "1" for Sacramento year 
one, and "0" otherwise. Finally, the "NONSMDM" coefficient shows the 
change in the first-year level for the comparison group relative to its 
baseline level. It is coded "1" for comparison group year one and "0" 
otherwise. 

Three significance tests follow the regression results. They 
evaluate the extent to which the coefficients for the variables in the 
model differ from each other. The "SMNONSM" test evaluates the 
significance of the difference between the first-year results for SM-ALC 
relative to the results for the comparison ALCs (i.e., SMDM-NONSMDM). 
The "'SMDMSMBS" test evaluates the first-year SM-ALC level relative to 


its baseline level (SMDM-SMBS). Finally, the key measure is the 


- 330 - 


"SMDMDIFF” test, which evaluates the difference in change curing the 
first year between SM-ALC and the comparison sites (i.e., 
SMDM-SMBS-NONSMDM) . 

For example, the regression results for the salary for the DH-1 
band indicate that the hourly pay rate for the comparison ALCs at 
baseline was about $8.21. The SM-ALC pay rate at baseline was about 
$0.89 higher (about $9.10/hour) according to the model. This difference 
was statistically significant (t = 3.96, p < .0001). The first-year 
SM-ALC rate was about $0.37 higher than the baseline rate for the 
comparison ALCs (about $8.58). The difference reached statistical 
significance (p < .0443). Finally, the first-year comparison ALC pay 
rate was about $0.50 lower than its baseline rate (about $7.71/hour). 
The reduction was significant (t = -3.001, p < .0029). 

The significance tests below the regression indicate that: (a) the 
first-year pay rate at SM-ALC was significantly higher than the 
comparison group's first year (.37 - (-.50) = $.87, p < .0001); (b) the 
decline in pay for the band at SM-ALC between baseline and first-year 
was significant (.37 - .89 = $-.52, p < .0001); and (c) the first-year 
change in pay at Sacramento did not differ statistically from the change 
at the other ALCs (.37 - .89 - (-.50) = $-.02, p < .9346). 

Overall, then, the regression results indicate that at baseline the 
DH-1 pay rate at SM-ALC was higher than (the average rate) at the other 
ALCs. During year one, the pay rate for the band was reduced throughout 
the system. The reduction at SM-ALC was the same as that for the 
comparison group. Nonetheless, the SM-ALC pay rate remained 
significantly higher than at the other ALCs. 

The remaining measures required analysis of both the current and 
history files within the automated personnel system. Significance tests 
for these measures were performed by a Z- (normal approximation) test 
for significance of the difference in percentages. A Z-score of 1.96 is 
significant at the p < .05 level. Table D.9 shows the percentage of 
crossovers from blue- to white-collar and white- to blue-collar jobs for 
the ALCs during baseline and year one of the demonstration by ALC. The 


second page shows significance test results for Sacramento versus the 


average across tne other ALUs. labile v.iv tollows che same format for 


separations and migrations (internal transfers) at the directorate 


level. Table D.11 breaks out tiie turnover results by career category 
(career versus career-conditional). Table D.12 shows the separation and 
migration results by pay schedule. Finally, Tab!e D.13 shows the 
turnover results at division level within the Directorate of 


Distribution. 
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Table D.3 


TII.C.1 SUPERVISION LEVELS 
(Percentage of Work Force) 


SUPERVISION 
LEVEL 
1 6.21% 7.93% 7.71% 8.05% 
2 2.69% 2.46% 2.24% 2.26% 2.40% 
3 0.28% 0.75% 0.71% 0.48% 0.47% 
1,2 or 3 11.14% 10.66% 10.79% 9.61% 
(N) 2528 1867 2542 1678 2331 
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Table D.9 
PAY SCHEDULE CROSSOVERS 


".A.2 CROSSOVERS N.A.2 CROSSOVERS 
BASELINE DEMONSTRATION 
ALCS ALCS 
oc jee) SA SM WR oc foe) SA SM WR 
DH TO DW 1.34%. 1.25% 0.86% 0.37% 0.67% 2.25% 2.47% 3.51% 1.32%: 0.94% 
OW TO OH 


“ear| ~ie2a]_(io00] 777] 1803 “7998) 
88 839 1,000 777 903 914 875 1,004 792 


1.4.2 CROSSOVERS 


BASELINE DEMO 
SM OTHER SM OTHER 
OH TO OW 0.37% 1.02% 1.32% 2.25% 
(816) (3,822) (835) (3,910) 
OW TO OH 0.26% 0.52% 0.76% 1.29% 


(777) (3,629) (792) (3,728) 


Baseline difference between SM-ALC and others, 
DH to DW Z = -1.71; DW to DH Z = -1.25 

First year change at other ALCs, 
DH to DW Z = 4.26; DW to DH Z = 3.45 

Difference in first year change at Sacramento 
DH to DW Z = -0.53; DW to DH Z = -0.63 


Table D.10 
TURNOVER 


Vi.0.1 SEPARATIONS BY ALC 
BASELINE 
ALCS 


o {oe} SA SM WA 
[ase] erosl gare) gore] ges 
2,363 2,374)} (2,013)| (2,442 


Vi.D.1 MIGRATIONS BY ALC 
BASELINE 


Percent 


ALCS 


co fee) SA SM WR 
_asel ar @aral gor] eauai 


v1.0.1 TURNOVER BY ALC 
BASELINE 
ALCS 


a ee. 
[essa] area] esa] gor] aay 


Percent 
N 


Percent 
N 


Vi.D.1 SEPARATIONS BY ALC 
DEMONSTRATION 
ALCS 


o (oe) SA SM WR 
2236) 
2,190 1,890 2,123 1,751 2,236 


V1.D.1 MIGRATIONS BY ALC 
DEMONSTRATION 


oc © SsA_ Mw Ww 
_2rsol scold gran arent 2236) 
1,890) (2,123) (1,751) (2,236 


VLD.1 TURNOVER BY ALC 
DEMONSTRATION 


ALCS 
oc 


©  sA_ SM wR 
[i2rool eco! rz) u.7siL (2236) 
1,890] (2,123) (1,751) (2.236 
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Table D.10--continued 


v1.0.1 SEPARATIONS BY ALC 

BASELINE OEMO 

SM OTHER SM OTHER 
Percent 10.89% 8.56% 7.02% 6.152% 
N (2,013) (9,304) (1,751) (8,439) 


VI.D.1 MIGRATIONS BY ALC 

BASELINE DEMO 

SM OTHER SM OTHER 
Percent 3.892 2.81% 451% 6.32% 
N (2,013) (9,304) (1,751) (8,439) 


VI.D.1 TURNOVER BY ALC 

BASELINE DEMO 

SM OTHER SM OTHER 
Percent 14.65% 11.36% 11.54% 12.47% 
N 


(2,013) (9,304) (1,751) (8,439) 


Baseline difference between SM-ALC and others 
Separations Z = 3.24; migrations Z = 2.44; 
total turnover Z = 4.13 


First year change at other ALCs 
Separations Z = -6.11; migrations Z = 11.30; 
total turnover Z # 2.27 


Difference in first year change at Sacramento 
Separations Z = -1.40; migrations Z = -3.89; 
total turnover Z = -3.52 


CAREER 


(270 (33 (281 


Total 
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Table D.11 


TURNOVER BY CAREER CATEGORY 


Vi.D.1 SEPARATIONS BY ALC 
BASELINE 
ALCS 


co jee) SA SM WR 
1.973 1,855)|_ (1,998)|_ (1,676)| (2,161 


66% 98.93% 10.89%  8./6% 
(2/363) @ 125) (2,374) (2,013) (2,442) 


VLD.1 MIGRATIONS BY ALC 
BASELINE 
ALCS 


o c = SA SM WR 
HURL He age sel oi 


comnmonaty a gl ‘gal la 


Total 


1.74% 4, a 83% 3 
(2,363) (2, pe (2,374) (2,013) (2, bis 


Vi.D.1 SEPARATIONS BY ALC 
DEMONSTRATION 
ALCS 


co fee) SA SM WR 
1,826 1,639 1,729 1,476 1,950 
364 251 394 275 286)} 
90% 492% 499% 02% 6.57% 
(2,190) (1,890) (2,123) (1,751) (2,236) 


Vi.D.1 MIGRATIONS BY ALC 
OEMONSTRATION 
ALCS 


o 2°) SA SM WR 
1,826)} (1,639)]_(1,729)] _(1,476)|_ (1,950 
eel ‘aad “eel eel a 
64 (394 (275 (286) 
33% = 11.11% 09% 451% 6.35% 
(2,190) (1,890) (2.123) (1,751) (2,236) 
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Table D.ll-continued 


VI.0.1 SEPARATIONS BY ALC 
DEMO 


Sonne 
OTHER SM 
CAREER 11.40% 8.86% 6.91% 


(1,676) (7,98 1,476 
CONDITIONAL 8.01% aay eae 


(337) (1,317) (275) 
7 


Total 10.83% 8.56% 


02% 
(2,013) (9,304) (1,751) 


OTHER 


6.12% 
(7,144) 
6.33% 
(1,295) 
6.15% 
(8,439) 


VI.D.1 MIGRATIONS BY ALC 
BAS 


ELINE DEMO 


SM OTHER SM 
CAREER 2. a 1.87% 5.08% 
(1,676) (7,98 1,471 
CONDITIONAL 12.17% Hse on 
(337) (1,317) 275 
Total 3.63% 2.81% Pets 
(2,013) (9,304) (1,751) 


Baseline difference between 
SM-ALC and others 


Career 
Career-conditional 


First year change at other 
ALCs 


Career 
Career-conditional 


Difference in first year change 
at Sacramento 


Career 
Career-conditional 


OTHER 


7.29% 


Separations 


N 


~1.57 
~0.01 


Migrations 


NN 


= 16. 
= -9, 


= -3. 
a -l. 


20 
Ll 
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Table D.12 
TURNOVER BY PAY SCHEDULE 


VI.D.1 SEPARATIONS BY ALC VI.D.1 SEPARATIONS BY ALC 
BASELINE DEMONSTRATION 
ALCS ALCS 


cc co SA SM WR 
: 20) ‘a34 “989 (852 i Mag 1,042 806 894 769) (1,061 
Tel es 
91 878 977 795 941) 


Ox 6.93% Soa oat 4.81%| 8.15% 
2311 (205 251 
Total 8.89 10.79% 8.77% 90% 4.92% i 
(2, 363} (2.124) (2.373) (2,012) (2,440) (2,190) (1,889) (2,122) (1,751) (2.235) 
V1.D.1 MIGRATIONS BY ALC VI.D.1 MIGRATIONS BY ALC 
BASELINE DEMONSTRATION | 46 


oC fee] SA SM WR 

ae ae 
oi». 83% 15% <<) 5.09% 451% 6.35% 

(2, 363) (2.124) (2,373) (2,012) (2,440) (2,190) (1,889) (2.122) (1.751) (2,235) 
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Table D.12--continued 


VI.0.1 SEPARATIONS BY ALC 
BASELINE DEMO 
SM OTHER SM OTHER 
; 6.34% 
(3,803) 
6.14% 
(3,713) 
5.43% 
(920) 
. : E 6.15% 
(2,012) (8,436) 


VLD.1 MIGRATIONS BY ALC 
BASELINE DEMO 
SM OTHER SM 
1.76% 
(852) 
6.28% 
(940) 
1.36% 
(220) 
3.83% 
(2,012) (1,751) 


Baseline difference between 
SM-ALC and others 


Difference in first year change 
at Sacramento 


DH 


DW 
DX 


Separations 


Migrations 
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Table D.13 
TURNOVER BY DIVISION 


Vi.0.1 SEPARATIONS 8Y ALC 


BASELINE 
ALCS 
x foe) SA SM wR 
971 684 845 
cm Oe es el eal ea 
173 18 
soe a aie ee 
74 0 82 
oe ye ee ea 
(513 
oer an eal oa 
659 629) 719 712) 
6 
Total 87% 866% 8.93% 10.83% 6% 


(2.383) (2.125) (2374) (2.013) (2,442) 


VLD.1 MIGRATIONS BY ALC 
BASELUNE 
ALCS 


ree 
971 859 

io ess = ae a 
173 O 228) 

08Q | altos me 0.00%} 3.03 
aa 8 99) 

oss pn i 3. 04% 0 
079) 417) {§40) 


ost 1. i a z O2%| 31 97% 
7194 §30) 7 

Other Boa 0 Sood TE 400%, 0 00% 

{25) ia) 

Total 1 at 456% B 83% 278% 


(2.363; (2.125) (2.374) (2.013) (2,442) 


VI.0.1 SEPARATIONS BY ALC 
DEMONSTRATION 
ALCS 


c @ SA Ma WR 
[Saal “al ‘eal Saal “ 
(899) 758 (668 797} 

2. poe 4 ices 5.39%; 729 
ae a gl ae 
73 73 (92) 
esl al Seed al a 
(360) (S05 
vee g y . 88 


(2.190) pote Qazs (1.753) (2.236) 


Vi.0.1 MIGRATIONS BY ALC 
DEMONSTRATION 
ALCS 


33% 1179% SOW 451% 535% 
(2.190) (1,8BC) (2123) (1.781) 2.236) 
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Table D.l3--continued 


V1.D.1 SEPARATIONS BY ALC VI.D.1 MIGRATIONS BY ALC 
BASELINE OEMO BASELINE DEMO 
SM OTHER SM OTHER SM OTHER SM OTHER 


3.43% 235% 3.59% 561% 
(757) (3,389) (668) (3.065) 
6.44% 3.79% 8.98% 706% 


ZR ES 
3 
J 
j 
9808 
4 
5 


DST 10.75% 9.16% 6.88% 7.39% 
(530) 


(2.719) (465) (2,484) ($30) (2.719) (465) (2.464) 

Other 12.00% 21.05% 10.00% 18.75% Other 4.00% 5.26% 15.00% 6.25% 
(25) (19) (20) (16) (25) (19) (20) (16) 

Tota) 10.83% 856% 7.02% 6.15% Total 383% 281% 451% 432% 
(2,013) ($,304) (1,751) (8.439) (2,013) (9,304) (1.781) (8.439) 


Separations Migrations 


Baseline difference between 
SM~ALC and others 


DSF 


z= 0.84 z= 1.71 

DSM Z= 2.13 z= 1.66 

DSQ z= 1.90 Z = -1.34 

DSS Z= 2.30 Zz b> 

DST Z= 1.15 Z = 85 

First year change at other ALCs 

DSF Z = -4.90 Z= 6.74 

DSM Z = =2.07 Z= 2.86 

DSQ Z = -2.81 Zz 0.68 

DSS Z = -1.68 Zz 6.85 

DST Z = -2.31 Z= §.45 
Difference in first year change at 

Sacramento 

DSF Z= 0.08 2 = -2.83 

DSM Z 2 -1.51 Z = -0.24 

DSQ Z = -0.22 Z2= 90.33 

DSS Z = ~0.68 Z = -1.69 

DST z= ~1.08 z= -3.30 
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Appendix E 


ADDITIONAL RESULTS FOR QUALITY MEASURES 


This appendix presents OLS regression results and annual ALC rates 
for the measures of work quality discussed in Sec. V of R-3943-FMP. 
Table E.1 shows regression results for the DSQ measures in Table 27; 
Table E.2 shows regression results for the DSM measures in Table 28. 
The model used in the regressions is the same in each case. The 
reference group (intercept) represents the 1985-1987 quality level for 
the comparison ALCs. The "SMBS" coefficient indicates how the baseline 
quality level at SM-ALC differed from the reference group's. It is 
coded "1" for Sacramento baseline and "0" otherwise. Similarly, the 
"SMDM" coefficient indicates how the first-year SM-ALC quality level 
differed from the reference group's baseline level. It is coded "1" for 
Sacramento year one and "0" otherwise. Finally, the "NONSMDM" 
coefficient shows the change in the first-year quality level for the 
comparison group relative to its baseline level. It is coded "1" for 
comparison group year one and "0" otherwise. 

Three significance tests follow the regression results. They 
evaluate the extent to which the coefficients for the variables in the 
model differ from each other. The "SMNONSM” test evaluates the 
significance of the difference between the first-year levels for SM-ALC 
relative to the results for the comparison ALCs. The "SMDMSMBS" test 
evaluates the first-year SM-ALC quality level relative to its baseline 
level. Finally, the key measure is the "SMDMDIFF" test, which evaluates 
the difference in change during the first year between SM-ALC and the 
comparison sites. 

For example, the regression results for measure (DEP VARIABLE) BL? 
indicate that the expected error rate for the comparison ALCs at 
baseline was about 2.1 percent. The SN-ALC error rate at baseline was 
about 5.2 percentage points higher (about 7.3 percent) according to the 
model. This difference was statistically significant (t = 8.69, p < 


.G001). The first year SM-ALC error rate was about .5 percentage pcints 


higher. than the baseline rate for the comparison ALCs (about 2.6 


percent). The difference did not reach statistical significance (t = 
-84). Finally, the first-year comparison ALC error rate was about .9 
percentage points lower than its baseline rate (about 1.2 percent). The 
reduction was significant (t = -2.21, p < .0283). 

The significance tests below the regression indicate that: (a) the 
first-year BL7 error rate at SM-ALC was significantly higher than the 
comparison group's first-vear rate (.53 - (-.91) = 1.44 percentage 
points, p < .0269); (b) the improvement in quality at SM-ALC between 
baseline follow-up was significant (.53 - 5.23 = -4.70 percentage points 
in the error rate, p < .0001); and (c) the first-year change in the 
error rate at SM-ALC was significantly greater than the change in the 
error rate at the comparison sites ((.53 - 5.23) - (-.91) = -3.79 
percentage points, p < .0001). 

Overall, then, the regression results indicate that at baseline the 
BL7 error rate at SM-ALC was higher than (the average rate) at the other 
ALCs. During year one, the error rate was reduced throughout the 
system. The improvement at SM-ALC was significantly greater than for 
the comparison group. Nonetheless, the SM-ALC error rate remained 
higher than at the other ALCs. 

Tables E.3 and E.4 show each ALC's quality rates in 1985, 1986, 
1987, 1988, and early 1989 for each measure in Tables 23 and 24, 
respectively. The tables show the average rate for each year and the 


number of months on which the average is based. 
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DSQ MEASURES 


SUPPLY 
BL7: CONTROLLED EXCEPTIONS 
PRESERVATION, PACKAGING, AND PACKING OF MATERIEL 
PL4: PACKING PROCESS 
MATERIEL PROCESSING AND RECEIVING INSPECTION 
RL2: INSPECTION 
RL5: TAILGATE DATE ACCURACY 
STORAGE 
SL1: LOCATER ACCURACY 
SL4: SELECTION FOR SHIPMENT/ISSUE 
SL6: WAREHOUSE LOCATION FILE MAINTENANCE ACTIONS 
TRANSPORTATION 


TL3: COMPATIBILITY OF PALLETIZED SHIPMENTS AND FINAL 
MANIFEST 


INVENTORY 


VL1: LOCATION AUDIT PROGRAM SURVEY (LAPS) (PHASE 1) 


VL2: PHYSICAL COUNT OF CLASSIFIED AND SENSITIVE 
INVENTORY 


VL3: PHYSICAL COUNT OF NON-CONTROLLED ITEMS 


(WALL-TO-WALL, SPECIAL, SAMPLE AND SELECTED ITEM 
INVENTORIES) 
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How to Read Regression Results 


ALC 
SM Other 
Data Period Follow-up 
Baseline 


Parameters 

A = Intercept 

B = Sacramento Baseline Parameter Estimate 

C = Sacramento Demonstration Parameter Estimate 
D = Other ALC Demonstration Parameter Estimate 


Tests 

SMNONSM = C-D 
SMDMSMBS = C-B 
SMDMDIFF = C-B-D 


Example: DSQ BL7 Regression 


ALC 
SM Other 
Data Period Follow-up 
Baseline 7.305 


Parameters 

2.072 = Intercept 

5.233 = Sacramento Baseline Parameter Estimate 

0.534 = Sacramento Demonstration Parameter Estimate 
-0.910 = Other ALC Demonstration Parameter Estimate 
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